A Block-GTH Algorithm for Finding the Stationary Vector of a Markov Chain
نویسندگان
چکیده
Grassman, Taksar, and Heyman have proposed an algorithm for computing the stationary vector of a Markov chain. Analysis by O'Cinneide confirmed the results of numerical experiments, proving that the GTH algorithm computes an approximation to the stationary vector with low relative error in each component. In this work, we develop a block form of the GTH algorithm, more efficient on high-performance architectures, and show that it too produces a vector with low relative error. We demonstrate the efficiency of the algorithm on vector processors and on workstations with hierarchical memory. 1. Introduction. We consider the problem of computing the steady state distribution of a finite, discrete time, irreducible Markov chain. Equivalently, we seek the left eigenvector r corresponding to the eigenvMue 1 of a stochastic matrix P:
منابع مشابه
A Parallel Implementation of theBlock - GTH algorithm
The GTH algorithm is a very accurate direct method for nding the stationary distribution of a nite-state, discrete time, irreducible Markov chain. O'Leary and Wu developed the block-GTH algorithm and successfully demonstrated the eeciency of the algorithm on vector pipeline machines and on workstations with cache memory. In this paper, we discuss the parallel implementation of the block-GTH alg...
متن کاملA direct projection method for Markov chains
A direct method based on oblique projections is adapted to compute the stationary distribution vector of a finite Markov chain. The algorithm can also be used to compute the group inverse of the corresponding generator matrix. It is shown how to update the stationary vector and other quantities of interest when one row of the transition probability matrix is modified. A GTH-like variant that ap...
متن کاملRecursive Algorithm for the Fundamental/Group Inverse Matrix of a Markov Chain from an Explicit Formula
We present a new accurate algorithm (REFUND) for computing the fundamental matrix (or closely related group inverse matrix) of a finite regular Markov chain. This algorithm is developed within the framework of the State Reduction approach exemplified by the GTH (Grassmann, Taksar, Heyman)/Sheskin algorithm for recursively finding invariant measure. The first (reduction) stage of the GTH/S algor...
متن کاملRelative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملAN APPLICATION OF TRAJECTORIES AMBIGUITY IN TWO-STATE MARKOV CHAIN
In this paper, the ambiguity of nite state irreducible Markov chain trajectories is reminded and is obtained for two state Markov chain. I give an applicable example of this concept in President election
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- SIAM J. Matrix Analysis Applications
دوره 17 شماره
صفحات -
تاریخ انتشار 1996